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We propose and analyze a new candidate Lyapunov function for relaxation towards general 
nonequilibrium steady states. The proposed functional is obtained from the large time asymp- 
totics of time-symmetric fluctuations. For driven Markov jump or diffusion processes it measures 
an excess in dynamical activity rates. We present numerical evidence and we report on a rigorous 
argument for its monotonous time-dependence close to the steady nonequilibrium or in general af- 
ter a long enough time. This is in contrast with the behavior of approximate Lyapunov functions 
based on entropy production that when driven far from equilibrium often keep exhibiting temporal 
oscillations even close to stationarity. 
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Steady nonequilibrium refers to a time-homogeneous 
regime in which currents are maintained through an open 
system. These currents displace particles, charges or en- 
ergy between reservoirs that together constitute the envi- 
ronment of the system. The different reservoirs are con- 
veniently fixed as spatially separated and macroscopic, 
with fast relaxation regarding the coupling to the sys- 
tem, and each being kept at a thermodynamic equilib- 
rium for specific temperature, pressure and chemical po- 
tential. The phenomenology ranges from small systems 
like molecular motors producing mechanical work by hy- 
drolysis of ATP [f , to large-scale systems like the earth 
atmosphere exhibiting energy flows between the poles 
and the equator 2\. On the relevant time-scales the 
stability of these manifestly nonequilibrium systems to 
small disturbances follows from their mere existence, but 
has not been described theoretically in a unifying frame- 
work. Previously, most efforts concentrated on the linear 
irreversible regime and on the entropy production in the 
context of irreversible thermodynamics, In contrast, 
our work goes beyond the linear irreversible regime, fits 
within recent efforts in the construction of nonequilib- 
rium statistical mechanics and, most importantly, is not 
formulated in terms of entropy and its changes. 

When the system is weakly coupled to the "frustrat- 
ing" environment we obtain Markov processes effectively 
describing the stochastic dynamics of the relevant degrees 
of freedom, [4], and nonequilibrium is associated to the 
violation of detailed balance. In these circumstances the 
stability of the steady regime is mathematically described 
by identifying a large basin of initial conditions that are 
all dynamically attracted to a unique steady state with 
some well defined stationary distribution. In equilib- 
rium however, when the system is passive and no net 
currents are flowing, a much stronger and more relevant 



notion of stability is available: the Helmholtz-Gibbs vari- 
ational principle characterizes equilibrium as extremizing 
thermodynamic potentials such as entropy, enthalpy or 
free energies depending on the constraints. At the same 
time these (equilibrium) thermodynamic potentials are 
related to heat and work and their derivatives inform us 
about the response to external stimuli. The relaxation 
to equilibrium is accompanied by a loss of the system 
free energy, or an increase of entropy in the universe. H- 
theorems, first formulated by Boltzmann for a dilute gas, 
add explicit witnesses, sometimes called H-functionals 
or Lyapunov functions, that show monotone behavior in 
time towards their equilibrium value. 

So far, little on a same level of generality has been 
reported for the relaxation to steady nonequilibria, while 
all the same their stability is plainly visible already in 
daily observations. The present letter addresses this 
issue of monotone return for nonequilibrium systems 
as modeled via Markov processes that are traditionally 
used in the effective description on mesoscopic scales. 
Our approach develops a similar framework as works 
well in equilibrium, yet it differs in one important aspect: 
instead of starting from static fluctuation theory which 
gives the relative entropy as Lyapunov function, we 
consider here its dynamical counterpart. The dynamical 
activity is a kinetic measure of noise or reactivity through 
which the system changes its state in the course of time. 
It has been found relevant for glassy dynamics and in 
kinetically constrained models, f5], and it enables a more 
precise formulation of some older ideas due to Landauer 
[5]. In this letter we show that a particular excess 
dynamical activity yields a nonequilibrium Lyapunov 
function. The resulting variational principle and the 
related H-theorem also provide a natural generalization 
and correction to existing but approximative entropy 
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production principles. 

Monotonicity from static fluctuations. Before going 
into the details of our proposal, we first recall the equi- 
librium case by which we mean that detailed balance is 
satisfied. Let us stick to descriptions in terms of Markov 
processes say for a multilevel system in contact with a 
single thermal bath at inverse temperature /3. The corre- 
sponding Markov evolution is then given in terms of tran- 
sition rates fco(x, y) between states (levels) x ^ y satisfy- 
ing the condition of detailed balance kQ{x,y)/ko{y, x) = 
exp^[J7(a;) — U{y)] with respect to energy function U. 
The stationary distribution is given by the Boltzmann- 
Gibbs factor po{x) = exp[— fHU (x)] / Z . The evolution of a 
probability distribution fit satisfies the Master equation 
Mx) = J2y[fJ't{y)ko{y,x) - fit{x)ko(x,y)] for which, un- 
der standard conditions such as irreducibility, fit — ^ Po 
exponentially fast. Much more is true however. The free 
energy functional F{fi) = J2x + ln^(a;)] 

decreases in time to its equilibrium value, F{fit) — 
F{po) — —f3^^\nZ. The mathematical reason is that 
the relative entropy 
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of the evolved distribution with respect to the presumed 
unique stationary distribution p (even when totally un- 
known) is always decreasing to zero, while for equilib- 
rium, s{p,t I Po) = l3[F{pt) — F(po)]. Hence, for a detailed 
balance dynamics we can take the free energy to serve as 
(equilibrium) Lyapunov function. 

While the monotonicity of ([T]) follows from a gen- 
eral convexity argument, there is a deeper and physi- 
cally more relevant reason for it at least for equilibrium 
systems. There the free energy also appears as fluctu- 
ation functional, much in the spirit of the Boltzmann- 
Planck formula S = kg log W for the thermodynamic 
entropy S in terms of the "plausibility" W oi a macro- 
scopic condition. Indeed, as emphasized and heavily em- 
ployed already by Einstein and later Onsager the for- 
mula exp^S/ks) can be used to estimate the relative oc- 
currence of equilibrium fluctuations. Similarly, the free 
energy F{p) governs the fluctuations of an ensemble of 
N independent copies of the equilibrium system, in the 
sense that asymptotically for — >■ oo, 
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In other words, the ensemble frequency of state occupa- 
tions is given by p with an exponentially small probabil- 
ity when /i 7^ po, while, by the law of large numbers, the 
probability in ([2| approaches one for p = pQ. That also 
explains why the Gibbs variational principle holds true. 

In the absence of detailed balance the free energy 
difference in ([2| should be replaced by the relative 



entropy ([T]). The relative entropy can therefore be taken 
as a static fluctuation potential and starting point to 
construct (generalized) thermodynamic potentials [7]. 
However, only for detailed balanced dynamics corre- 
sponding to equilibrium, has ([T]) the usual interpretation 
in terms of thermodynamic potentials. Moreover and 
much more important, away from equilibrium funda- 
mentally new observables related to the kinetics and to 
dynamical fluctuations become relevant and it is hence 
desirable to look for a natural dynamic alternative to 
the concept of relative entropy. We give such a proposal 
in the sequel. 

Monotonicity from dynamical fluctuations. In the 
case of dynamical fluctuations, one investigates devia- 
tions from typical time-averages. Again we work with 
a Markov dynamics as above where we now have quite 
general jump rates k{x, y) for an irreducible process with 
stationary distribution p. Denoting by xt the state of the 
system at time i, we consider 

Pr{x) = - / Sxux'^^t (3) 

T Jo 

i.e., the fraction of time spent in each state x. Also in 
this case a fluctuation formula holds, this time for large 
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This D{p) is the rate function for dynamical fluctua- 
tions. We call it the Dynamical Activity (DA). It gives 
a dynamical analogue of ([2|, see also Like for 

static fluctuations we have the immediate property that 
F>{p) > D{p) — 0, expressing the fact that the probabil- 
ity of a fluctuation p tends to zero for large times and 
Pt{x) — )■ p{x). The central question in this paper how- 
ever asks more: does D{pt) decrease monotonically in 
time when pt evolves according to the Master equation? 
For this we need to see first how we can compute this 
DA. Following the results of [10], the following algorithm 
can be given. First, we modify the transition rates by 
applying an extra potential A, 

-A{y)-A{x) 



k{x,y) kAix,y) 
to define 

D{p,A)=J 



k{x, y) exp 



p{x)[k{x,y) - kA{x,y)] 
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Note that J2y ^(2^7 u) ^-re the escape rates. So D{p, A) is 
given in terms of an excess in expected escape rate when 
mutually comparing the original with the A— modified 
system, when occupations are distributed with p. The 
DA is then obtained from the following equations: 

D{p) = D(p,V) 

[kv{x, y) p{x) ~ kv{y, x) p{y)] = (6) 
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In words, given a probability distribution fi we find the 
potential V, or the extra force V{x) — V{y) applied over 
the transition x ^ y such that now becomes stationary 
for the modified system with transition rates fcy (x, y). In 
fact, we prove in [F| that this problem has a unique (up to 
a constant) solution. The construction above makes con- 
tact with the blowtorch theorem of Landauer, [S], since 
the modification of the dynamics can be interpreted as 
inserting an extra possibility of energy exchange. The 
extra potential V can in that same sense be called the 
blowtorch and monitors changes in the kinetics. 

An advantage over working with ([I]), in principle, is 
that the definition of the DA does not depend on the 
stationary distribution. Yet, finding the correct V for a 
given distribution ji entails solving the inverse problem 
([6]), and is therefore analytically at least as challenging 
as finding the stationary distribution (needed for static 
fluctuations). However, a straightforward computation 
shows that the function -D(/i, A) is concave as a function 
of A and is maximal at D{^,V) — D{ii). Therefore, for 
computing the DA one can use all the numerical power 
of maximizing algorithms. 

Relation to entropy production principles. The instan- 
taneous Entropy Production Rate (EPR), |l3j, is given 

by 
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Only under detailed balance does EPR coincide with 
minus the time-derivative of ([!]). In [llj minimum and 
maximum entropy production principles for Markov 
processes as in e.g. |12| were understood in terms of 
dynamical fluctuation theory. The key-point is a re- 
markable simplification of the above formula for D{^) in 
the close-to-equilibrium regime where detailed balance is 
only weakly broken, and for ji not too different from the 
stationary distribution p. Under these special conditions 
one finds that D{p) ~ [£{p) — f (p)]/4. It is exactly 
this relation to the dynamical fluctuation law that 
lies behind the close-to-equilibrium validity of various 
entropy production principles. In that same regime, the 
EPR is also a Lyapunov functional. Although this EPR 
continues to make sense as dissipation rate far from 
equilibrium, it is then no longer related to the DA, nor 
does it give a minimum entropy production principle, 
nor is it monotonous in time. 

D(/i) as a Lyapunov functional. We present here 
the evidence that our dynamical activity functional 
D{iJLt) becomes monotonically decreasing to its station- 
ary nonequilibrium value D{p) = substantially beyond 
the close-to-equilibrium regime, in contrast to the EPR. 
We first demonstrate our hypothesis numerically via ex- 
amples for which the DA has been computed by the vari- 
ational algorithm indicated above. As our first example 



we consider the simple symmetric exclusion process on a 
lattice interval with open boundaries where different par- 
ticle densities are imposed left and right. It constitutes 
a paradigmatic nonequilibrium model that for example 
simulates effects of ion hopping through small channels. 
Because the driving is via the open boundary, the system 
is further away from equilibrium for smaller sizes — to 
be specific, we have taken a sequence of 6 sites. For this 
system we have numerically checked the time-evolution of 
both the fluctuation functional D(fit) and £{p,t)- Several 
initial distributions have been explored. We flnd that for 
a large range of different particle densities imposed at 
the open ends and for different initial distributions, both 
functionals monotonically decrease in time. One might 
be tempted to conclude from this that the EPR is as good 
a candidate to be a Lyapunov function as D(fi). How- 
ever, this is not true, as the next example demonstrates. 

As our second example we have checked driven dif- 
fusion on a ring, which corresponds to the motion of a 
bulk-driven particle in a toroidal trap. It is experimen- 
tally very accessible, including its linear response behav- 
ior far-from-equilibrium }14j . We model this by a Markov 
jump process on a ring with N sites. The particle can 
hop one site to the left or right with hopping rates 



k(^x, x ± 



N' 
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exp{-/3[[/(x±^)-[/(a;)T^]} (8) 



which can be seen as a space-discretized version of the 
overdamped diffusion dynamics driven by the force /, 



(9) 



with C,t standard white noise. Again we have numeri- 
cally calculated both D{iit) and £{^it) with various ini- 
tial distributions and each time with forcing / compara- 
ble in size to dU/dx. The main difference between the 
two functions £{nt) and D{p,t) is illustrated in Fig. [T] 
in (a) the initial condition is far from stationarity. We 
see that D{^t) stops oscillating after some short time 
and becomes monotone, while the entropy production 
keeps oscillating all the way. This is made more clear 
in (b), where the initial distribution was taken close to 
the nonequilibrium stationary distribution. 

We finally turn to analytical arguments and we em- 
ploy a strategy that is common in linear stability theory: 
we linearize around the stationary distribution p which 
amounts to keeping only the leading order in the devi- 
ation p — p. That is exactly what we need for the long 
time behavior of the nonequilibrium system where indeed 
Pt gets closer to the stationary p as time t runs. In this 
approximation we have found 
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and with 



in terms of the stationary expectations 
L the linear operator on state functions defined by 
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FIG. 1: The functionals D{^it) and [£{^it) - £{p)]/4: for driven 
diffusion, with A*' — 100, /3 = 1, / = 5 and U{x) — cos{6-kx). 
In the case (a) the initial condition is far from stationarity: 
Hoix) = 1/2 + 1/2N for X = and ^iq = 1/2N otherwise. 
In (b) ^o(a;) = p{x) + du{x) with d = 0.1, iy{x) = ±1/N for 
X =g 0.5. 



iLV){x) = 'EyHx,y)[V{y) ~V{x)] (called, backward 
Markov generator). From ( [To| conditions for the mono- 
tonicity can be formulated. E.g. ( |10[ ) immediately im- 
plies the following sufficient condition: (fL^f) > V/, 
which can be reformulated in terms of the spectrum of 
L, see |8]. We want to focus however on necessary and 
sufficient conditions in terms of linear response behavior. 
This nonequilibrium response theory was e.g. studied in 
|15| : the transition rates of the system are modified as in 
([5]) with A — hrV (depending on time r), so that an ex- 
pression can be obtained for the auto-response function 
RviT) — ^^^(^^(xt-)) I when perturbing with potential 
V at time zero starting from stationarity. Remarkably, 



that exactly gives the right-hand side of (10), or, 
d 



dr 
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where Vt remains the potential as in ([6| determined by 
the distribution /ij. We therefore see that the long time 
monotonicity of -D(/it) is directly equivalent with "nor- 
mal" behavior of the auto-response. By "normal" we 
mean that the auto-response always starts out decaying 
in time. We leave the mathematical details to [8]. 

Conclusion and outlook. The dynamical activity func- 
tional ([6| is proposed as a new Lyapunov functional for 
the long time behavior of Markov evolutions. We have 
collected numerical evidence for some standard nonequi- 
librium models. Mathematically, we have found the 
equivalence between "normal" linear auto-response at 
short times and monotonicity of DA at long times. The 
rigorous formulation and proofs are collected in ^8], sup- 
porting and explaining our numerical findings. 

An important motivation to search for Lyapunov func- 
tions in the relaxation to nonequilibrium steady states 
comes from the problem of stability of competing ther- 
modynamic regimes in complex driven systems. Towards 
this application, the behavior of the dynamical activity 
needs to be further analyzed in the case of systems with 
a larger number of degrees of freedom. In order to recog- 
nize and exploit the dynamical activity and its changes as 



a thermodynamic state function, a more operational def- 
inition in terms of suitable thermodynamic processes is 
needed. This appears now to be one of the major relevant 
open problems when attempting to build a nonequilib- 
rium thermodynamic formalism beyond the by now well 
understood linear irreversible regime. A second interest- 
ing application relates to the notion of statistical forces 
outside equilibrium. Maximum entropy arguments gov- 
ern the relaxation to classical and quantum equilibrium 
alike. Outside equilibrium, from our present investiga- 
tions, it appears that the minimization of dynamical ac- 
tivity ^ (called motion out of noisy states in [5]) might 
non-trivially characterize the steady behavior. 
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